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The existence of optimal strategy in robust utility maximization is addressed when the 
utility function is finite on the entire real line. A delicate problem in this case is to find 
a "good definition" of admissible strategies to admit an optimizer. Under certain assump- 
tions, especially a kind of time-consistency property of the set V of probabilities which 
describes the model uncertainty, we show that an optimal strategy is obtained in the class 
of those whose wealths are supermartingales under all local martingale measures having a 
finite generalized entropy with one of P £ V ■ 



1. Introduction 

This paper analyzes a qualitative aspect of the problem of robust utility maximization. 
Given a utility function U and a set V of probabilities which describes the model uncer- 
tainty, the basic problem of this paper is to maximize the robust utility functional 

Xh> MEp\U(X)} 
Per 

over all terminal wealths x + 6 ■ St = x + Jq OdS of admissible strategies 6, where S is 
an underlying semimartingale. When U is finite only on the positive half-line, the dual- 
ity theory for this problem in the spirit of [15, 16] has been studied in both quantitative 
and qualitative aspects (e.g. [23], [22], [8]). In the case of utility taking finite values for 
all [18] shows the key duality, while [8] and [17] give a partial result on the ex- 

istence of optimal strategy which we shall complete in this paper. See also [9] for more 
comprehensive reference and the background of the robust utility maximization problem. 

A key subtlety intrinsic to the case of utility on R is the "good definition " of admissible 
strategies 0, which will constitute the central theme of this paper. In this case, a univer- 
sal and conceptually natural definition of admissibility is that 6 ■ S is uniformly bounded 
from below by some constant, which completely determines the quantitative nature of the 
problem. This class, however, typically fails to admit an optimizer. On the other hand, if 
U is — oo on R_, the only natural (non-redundant) definition of admissibility is that the 
stochastic integral ■ S is bounded from below by —x, and an optimal strategy is indeed 
obtained in this class under certain mild assumptions (see [23, 22]). 

In the classical case (i.e., V = {P}, say), the question of the good definition of admis- 
sibility is closely analyzed by [21] following the observation by [7] and [14] in the case of 
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exponential utility. [21] shows that a "good definition" which yields us an optimal strategy 
is that 9 ■ S is a supermartingale under all local martingale measures Q which has a "finite 
entropy" with the physical probability P. We denote the class of such 9 by ©y(P) (see 
Section 2 for precise definitions including the meaning of "finite entropy"). Note that this 
class contains the usual admissible class, and the supermartingale property is consistent to 
the "No- Arbitrage philosophy". Thus 0y(P) is acceptably natural choice when a single 
physical probability is specified. 

In the general robust case with V containing (infinitely) many elements, [8] (see also 
[17] for a slight generalization) provides a partial analogue of the above result which states 
that, under certain stronger assumptions, an optimal strategy is obtained in the class of 9 
with 9 ■ S being a supermartingale under all local martingale measures Q having a finite 
entropy w.r.t. a certain element P EV called a least favorable measure, i.e., in the class 
®v{P)- Here a dissatisfaction comes of course from the dependence of admissibility on 
P. In philosophy, V is the set of candidates of real world models, and we do not know 
which one is true. Thus an "admissible strategy" should be universally admissible for all 
candidates P E V. Also, the least favorable probability P is a part of solution to the dual 
problem of robust utility maximization, hence the class ©y (P) is not a priori available. 

In this view, a seemingly natural admissible class is f] Pe -p ®v(P) which is universal and 
contains all 9 whose stochastic integrals are bounded below. Thus our central question in 
this paper is: 

Question 1. Does the class f] PeV &v(P) admit an optimal strategy? 

The main result (Theorem 3.2) states that this is indeed the case if (in addition to stan- 
dard assumptions) the set V of candidate models has a time-consistency property. We 
proceed as follows. The first step is to construct a so-called "optimal claim" for the ab- 
stract version of robust utility maximization, from which a candidate of optimal strategy 9 
is derived through a predictable representation argument. This part is mostly standard ex- 
cepting some technicality, but we give a slightly better description of optimal claim. Note 
that the additional time-consistency assumption is not required at this stage. The crucial 
step is to verify the supermartingale property of 9 ■ S under all local martingale measures 
Q which has a finite entropy with some P E V but its entropy with P is infinite. We shall 
do this by a (slight surprisingly) simple trick. 

2. Formulation 

We fix a complete probability space (£2, J-,P) as well as a filtration F = {F^telo.T] sat ~ 
isfying the usual conditions, where T E (0,oo) is a fixed time horizon. Though many 
probabilities on (£2, F) will appear in the sequel, the probability P plays the role of refer- 
ence probability, i.e., every probabilistic notion is defined under P unless other probability 
is explicitly specified as £/>[•], L l (P) etc. In particular, the underlying asset prices S is a 
cZ-dimensional P-cadlag semimartingale, and we assume: 

(Al) S is P-locally bounded. 

Let V be a set of probabilities P<CP, which we can (and do) embed into L l via the 
mapping P H> dP/dP. In this sense, we assume: 

(A2) V is convex and cr(L 1 ,L 00 )-compact. 

We work with a utility function U :R->M which we assume 

(A3) U is differentiable, strictly concave on R, and U'(— oo) = oo, f/'(oo) = 0, 
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and satisfies the condition of reasonable asymptotic elasticity: 

xU'(x) xU'ix) 
(A4) liminf — > 1 and limsup — f^- < 1. 

Ulx) 

The conjugate of utility function U is denoted by V, i.e., 

(2.1) V{y) :=sup(U(x)-xy), yeR. 

xeM. 

The assumptions (A3) and (A4) guarantee that V is a "nice" convex function (see [10], [19] 
for details). Using this function, we introduce a generalized entropy: 



(2.2) V(y\P) 



E P [V(dv/dP)} ifv<C.P, 
+oo otherwise 



for any positive finite measure v <C P and P G V. When U(x) = 1 — e~ x (exponential 
utility) and Q is a probability with Q < P, we have V{Q\P) = E Q [log(dQ/dP)], i.e., the 
relative entropy. Abusing the terminology, we still call the map V(-|-) the generalized 
entropy associated to V. We define also the robust generalized entropy by 

(2.3) V(Q\V):= mf V(Q\P) <oo. 

Let M.i c be the set of all local martingale measures for S, i.e., probabilities Q <C P 
under which S is a local martingale. We then set 

(2.4) M v := {Q 6 Mioc : V(Q\V) < oo}. 

Generically, for any set Q of probabilities Q <§C P, we denote by Q e the set of Q € Q 
with 2 ~ P- We assume the existence of equivalent local martingale measure with finite 
entropy in the following sense: 

(A5) M e v :={Q€M v : g~P}^0. 

In particular, this implies the existence of (Q,P) G .My x T 5 such that 2 ~ f ~ P and 
y(Q\P) < oo. See [17] for detail and other consequences of these assumptions. 

Let L(S) be the totality of all (5,P)-integrable cZ-dimensional predictable processes, 
Lq(S) := {9 € L(S) : 9o = 0}, and we denote by ■ S the stochastic integral of 6 £ L(S) 
w.r.t. S. See e.g., [12] or [13] for more information. When the utility function is finite on 
the entire real line, a conceptually natural choice of © is 

(2.5) ® bh :={0e L Q (S) : • S = 0, 6 ■ S is bounded from below}. 
Then the value function of the robust utility maximization problem is given by 

(2.6) u(x):= sup M E P [U(x+e -S T )}, xeR. 

e&@ bb PeV 

When we seek an optimal strategy, however, the class is typically too small to admit an 
optimal strategy. We thus have to enlarge the admissible class. Our choice is the following. 

(2.7) S v := {9 € L (S) : • S is a g-supermartingale, Vg G M v }- 

Remark 2.1 (Another equivalent formulation). We have defined the classes M.y and 
®v through the robust generalized entropy Q M> V(Q\P). But the following equivalent 
formulation is sometimes useful for comparison. For each P £ V, we set 

(2.8) M V (P) := {Q € Mi oc ■ V{Q\P) < oo}, 

(2.9) & V {P) := {0 € Lo(S) : ■ S is a g-supermartingale V£ G M V (P)}. 
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When a single P 6 V is fixed as the physical probability, the class &v(P) is shown to be an 
appropriate domain of utility maximization in [21]. Recalling (2.3), our choices A4v and 
©v are rewritten respectively as 

M v = U Mv(P), ®v = f| & v(P)- 

Pev Pev 

Thus our definition (2.7) is consistent to what we wrote in introduction. 

Under the assumptions (Al) - (A5), a duality result (Theorem 2.3 of [18]) is applicable, 
which states in our case that for any © with &/,/, C © C ©v, we have 

(2.10) u[x) = sup inf E P \U (x+9-S T )} = inf inf (V(XQ\V)+Xx). 

e<z@Pev i>oQ£M v 

In particular, the value function is unchanged if we replace ®hb by the larger class ©v. 
Under the same assumptions, the right hand side, the dual problem of the (2.6), admits a 
solution (X,Q) £ (0,oo) x Mv, and the infimum V(Xq\V) = inf PeV V(%Q\P) is attained 
by a P e V since V is weakly compact, and V (-|-) is lower semicontinuous. Thus the right 
hand side of (2.10) is also written as V(XQ\P), and we call the triplet (X,Q,P) a dual 
optimizer. 

A way of proving (2. 10) and the existence of a solution (A, Q) is to closely analyze the 
robust utility functional X H> inf p & <p Ep[U (X)] on L°° characterizing V(-\P) as its conju- 
gate. Then the duality and the existence of (X,Q) follow simultaneously from Fenchel's 
duality theorem. See [18] for detail. Alternatively, one can separate the dual problem into 
the minimization of A H> infgg^vi^ V(XQ\P) +Xx and of Q H> V(XQ\P) for each X. For 
the latter problem, called the robust f -projection, [8] proves the existence by establishing 
a uniform integrability criterion in terms of V (• \V) in the spirit of the de la Vallee-Poussin 
theorem. 

In contrast to the standard utility maximization, neither the uniqueness of (X,Q) (hence 
of the triplet (A , Q,P)) nor the equivalence Q ~ P hold in the robust case, as the following 
trivial example illustrates: 

Example 2.2. Suppose M. e , ^ 0, and that M.i oc contains an element go which is not 
equivalent to P. Then we take V so that Qo e V C Aii oc - In this case, A is uniquely 
determined as the minimizer of A H> V (A ) + Xx. Then a triplet (A , Q, P) is a dual optimizer 
if (and only if) P = Q G V C A4i oc - Indeed, by Jensen's inequality and the strict convexity 
of V, V(XQ\P) = E P [V{XdQ/dP)} > V(X) whenever Q < P, and the "equality" holds if 
and only if Q = P. Hence (X,Q,P) is not unique, and (A,Qo> Qo) is a solution with Qq / P. 

As for the equivalence, we still have Q ~ P whenever (X,Q,P) is a dual optimizer 
(see [17], Theorem 2.7). Also, by an exhaustion argument, there exists a maximal solution 
(X,Q,P) in the sense that if (X,Q,P) is another dual optimizer, then Pcf (hence Q<^Q) 
and XdQ/dP = XdQ/dP, P-a.s., where the density dQ/dP is defined P-a.s. in the sense of 
Lebesgue decomposition. In particular, if (A , Q, P) and (A , Q, P) are two maximal solution, 
then 

(2.11) XdQ/dP = XdQ/dP, P-a.s., 

See [17, Theorem 2.5 and Proposition 4.7]. This uniqueness is still useful in our purpose. 
Note finally that even such a maximal Q may fail to be equivalent to the reference probabil- 
ity P. See [23, Example 2.5] for a counter example. In the sequel, we fix such a maximal 
dual optimizer, and call P a least favorable measure. 

The duality (2.10) completely characterizes the quantitative nature of the problem (2.6). 
But our aim in this paper is to discuss the qualitative nature, especially the existence of 
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optimal strategy in @y . To do this, assumptions (Al) - (A5) are not enough, and we assume 
additionally 

(A6) sup Ep[U(0-S T )} <oo, yPeV e . 

ee® bb 

Remark 2.3. Several remarks on assumption (A6) are in order. 

1. This assumption is automatically satisfied if U(oo) := sup x U(x) < oo as exponential 
utility, and in this case, U(X) + 6 f] PeV L l (P) for any random variable X. Therefore, 
the robust utility functional X M> inf 'p e -p Ep[U (X)] is well-defined on L° as a [—00,00)- 
valued concave functional. 

2. If i/(oo) = 00, [2, Th. 1.1 and Remark 1.2] show under (A4) that (A6) is equivalent to: 

(2.12) VP € V e , 3Q E M v such that V(Q\P) < 00. 

This is further equivalent to saying that vp(y) < 00 for all y > and P £ V, where vp 
is the dual value function 

v P (y):= inf V(yQ\P), y>0. 
QeM v 

3. We could state (A6) with the whole V rather than V e . But for our purpose, (A6) is 
enough. Recall that (A5) implies in particular V e ^ 0. If P € V e , we have (P + P)/2e 
7>* for all PeP, and||X|| il((/)+/>)/2) = (||X|| il(/)) + ||X|| iI(/j) )/2>||X|| iI(/)) /2. Hence 
we have, for instance, 

(a) f]pevL l (P)=f]pev^ 1 (P); 

(b) if (X") is bounded in L l (P) for all P e V e , then the same is true for all PeV. 
In particular, (A6) (hence (2.12)) guarantees even in the case t/(oo) = 00 that 

(2.13) xe n L l (Q)^U(x) + e f^L'iP). 

QeM v Pev 

In fact, if V(Q\P) < 00 andX e L l (Q), Young's inequality implies U(X) < V(dQ/dP) + 
(dQ/dP)X e L 1 (P), and we can take such age M v by (2. 12) for all P E V. 

Remark 2.4 (Continuation of Remark 2.1). We give a brief comparison of admissible 
classes considered in literature. In [17], the class ©y(P) is used to discuss the existence of 
optimal strategy, while [8] considered (implicitly) a slightly smaller class: 

(2.14) M° V (&P) ■= {Q e Mioc : V{aQ + (1 - a)Q\P) < 00, 3a e (0, 1)}, 

(2.15) v (e,P).- j0GL o (5). veGXUG^) /' 

Note that ®^((2,P) C ©v(P) since C while if we set & m (Q) := {0 G 

Lq(S) : • S is a g-martingale}, 

®v n @,„ (g) c & v (P) n ® m OS) = @y (6, ^) n m (fi) . 

Thus ©v(P) and &y(Q,P) are essentially equivalent for the existence of optimal strategy 
(see Theorem 3.2). We just emphasize here that our class ©y depends neither on particular 



PeVnoiQe M v , while © V (P) and ® V (Q,P) do. 



We conclude this section by recalling a stability property of a set of probability mea- 
sures, called instability, which will be used in Theorem 3.2 below. 
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Definition 2.5 ([5], Definition 1). A set Q of probability measures is said to be in- 
stable (multiplicatively stable) if for any Q e Q, Q' e Q e with the density processes 
Zt = (dQ/dP)\jr t and Z\ = (dQ' /dP)\jr t , as well as any stopping time T < T, a new prob- 
ability Q defined by dQ/dV := Z Z (Z' T /ZQ is an element of Q. 

This property is equivalent to the time-consistency of the corresponding dynamic co- 
herent monetary utility function <pr(X) := essinfg e g£'g[X|.7 : " T ]: for any X,Y g L°° and 
stopping times d < T, ^t(X) < 0t(T) implies (j> a (X) < 0o-(T). This is further equivalent 
(under (A3)) to the time-consistency of the dynamic robust utility functional U X (X) := 
essmfQ e QEg[U (X)\J- T ]. See [5, Theorem 12] for details and precise formulation. Note 
that the set A4i oc of all local martingale measures is m-stable. 

3. Main Results 

We first state a result on a "weak solution" to the problem (2.6), which yields a candidate 
of optimal strategy. Let 

(3.1) X:={xeL°:Xe f] Qe M v ^ (6), ™p QeMv E Q [X] < o} . 

Note that 9 • S T € X if 9 e @ v , and X e X implies U(x +X) + e f]p e v L ' ( p ) for an Y x e M ' 
by (A6) and Remark 2.3. Thus the robust utility functional X i— > inf^gpEf^^+X)] is 
well-defined on ^. 

Theorem 3.1. Suppose (Al) - (A6), and letxEM, and (h,Q,P) be a maximal dual opti- 
mizer. Then there exists an X G X such that U(x + X) E f] Pe j,L l (P) and 

n ^ u(x) = sup inf E P \U(x + X)} = inf E P \U(x+X)]. 

where the infimum is attained by P. Moreover, there exists an (S ,Q)-integrable predictable 
process 9 with 9o = such that 9 ■ S is a Q-martingale (not only local) and 

(3.3) x+X = -V'(XdQ/dP)=x+9-S T , Q-a.s. 

In particular, X is Q-a.s. unique, and 9 is unique in the sense that 9 ■ S is unique up to 
Q-indistinguishability. 

The proof is given in Section 4. The first equality in (3.2) states that the robust utility 
maximization over terminal wealths x + 9 ■ St is (quantitatively) equivalent to the indirect 
utility maximization : 

u M v i x ) = SU P inf E P [U(x+X)], 

while the random variable X is the so-called optimal contingent claim. Such arguments 
are quite standard in (non-robust) utility maximization, and also in the robust case, [8, 
Theorem 3.11] shows a similar result: under (Al) - (A5), the assertions of Theorem 3.1 
hold true except that the sets Aiy (in the definition (3.1)) and V are replaced by M.y{Q,P) 
and 7 ,0 (2,P) defined respectively by Remark 2.4 and 

V°(Q,P) :={PeV: V(Q\aP+ (1 - a)P) < oo,3a e (0, 1)}. 

Note that our finite utility assumption (A6) is automatic if V is replaced by V (Q,P). 
Also, when U(oo) < oo, the set "P°((2,P) actually coincides with the whole set V ([8], 
Remark 3.10). However, Aiy(Q,P) still depends on (Q,P) which is the solution to the 
dual problem, hence not a priori available. On the other hand, our formulation is universal, 
which is a slight, but qualitatively crucial contribution. 
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Theorem 3.1 suggests that the "strategy" 9 is a candidate of optimal strategy. However, 
we still have to prove that this strategy is indeed admissible. 

Theorem 3.2. In addition to (Al) - (A6), we assume that Q ~ P and V is m-stable. Then 
9 is (S,V)-integrable (hence (S,P)-integrablefor all P £V), and 9 ■ S is a supennartingale 
under all Q £ Aiy. In particular, 9 belongs to &y and is an optimal strategy. 

The proof is given in Section 5. When V = {P}, the question of uniform supennartin- 
gale property of this type goes back to the "six-author paper" [7] which shows that the 
optimal wealth in exponential utility maximization is a martingale under all local martin- 
gale measures having a finite relative entropy with P, under an additional assumption on 
reverse Holder inequality which is later removed by [14]. Although this uniform martin- 
gale property is no longer true for other utility functions, [21] shows that the optimal wealth 
is a supermartingale under all Q £ Aly(P), for any utility functions on K with reasonable 
asymptotic elasticity. There are also some extensions to the case where the semimartingale 
S is not locally bounded. See e.g. [3] and [4]. 

In the robust case, the Q-supermartingale property for all Q £ AAy(P) (hence all Q £ 
A4 V (Q,P) since 9 ■ S is a 2- mart ingale) is shown by [8] (see also [17] for a slight exten- 
sion). We emphasize that the difference between Aiy(P) and M.y is essential here. Note 
that X is also optimal for the utility maximization problem under the fixed measure P, and 
the same is true for (X,Q) in the dual side. Thus the result of [21] cited in the previous 
paragraph is still applicable (under the assumption Q ~ P) for Q with V(Q\P) < oo, while 
we have to consider the case where V (Q\P) < oo for some P £V but possibly V (Q\P) = oo. 

To grasp the situation, we try to describe the heuristics behind the argument in [21] 
(from our point of view), and our idea of extending it. In what follows in this section, we 
suppose all the assumptions of Theorem 3.2, especially Q ~ P. 

For a moment, we suppose that 9 ■ S is a Q-supermartingale for some Q £ My. Then 
the Q-martingale property and the representation (3.3) imply: for any stopping time T <T, 

(3.4) E & [V'(XdC>/dP)\F z ] < E Q [V'(%dQ/dP)\F T ], g-a.s. 

On the other hand, Ansel-Strieker's lemma [1] shows that 9 S is a Q-supermartingale if 
and only if there exists a Q-martingale lower bound, i.e., a (2-martingale M@ such that 
9 S > M®, Q-a.s. In particular, if (3.4) holds true for any stopping time T < T, the process 
defined by = — Eq[V' (XdQ/dP)]^] provides a desired lower bound, hence (3.4) is a 
necessary and sufficient condition for 9 ■ S to be a Q-supermartingale. 

When V {Q\P) < oo, the inequality (3.4) is obtained as the variational inequality which 
characterizes Q as a minimizer of the functional Q n- V (XQ\P) when T = 0, and a "Bellman- 
type" principle using the m-stability of the set of local martingale measures shows the case 
of general T < T. 

If inf/> e p V (Q\P) < oo but V (Q\P ) = oo, this argument is no longer applicable at least 
directly. Mathematically speaking, we loose some important estimates to guarantee the 
necessary convergences, or more intuitively, any element Q with V (Q\P ) = oo is in no way 
optimal at very early stage, and we can not draw further information from the optimality of 
Q in the minimization of Q^?V{XQ\P). However, we have used only a part of information 
of Q so far, and it is natural to expect that a better information may improve the result. More 
specifically, 
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Step 1 the optimality of (Q,P) in the minimization of (Q,P) H> V(XQ\P) should yield a 
variational inequality similar to (3.4) but with an additional term involving P: 

" E^[V'{XdQ/dP)\F x ]+F T {P) <E Q [V'{XdQ/dP)\F r }+F t {Py\ 

Step 2 Though we may not take P — P in general, it seems natural to expect that we may 

take P "arbitrarily close to P" keeping V(Q\P) < oo with fixed Q. 
Step 3 If this is the case, we may expect (3.4) by an approximation argument: 

"F T (p)^F T {Py\ 

The formal inequality in Step 1 will be realized as Proposition 5.4 below, where the in- 
stability of V will play an important role. On the other hand, Steps 2 and 3 will be justified 
in a certain sense by a simple trick which is a consequence of reasonable asymptotic elas- 
ticity (Lemma 5.5). 

Remark 3.3 (What happens when Q ^ P?). The equivalence Q ~ P is automatic if all 
elements of V are equivalent to P. When the filtration F is continuous (i.e., every (F,P)- 
martingale is continuous, especially if it is generated by a Brownian motion), the latter 
condition is already implied by the m-stability of V and (A2) (see [5, Theorem 8]), thus it 
is not a further restriction in that case. 

In general, however, the equivalence Q ~ P may fail (see [23, Example 2.5] for a counter 
example), thus it is worth asking what happens in that case. When U is finite only on 
the positive half-line, the optimal claim X (which does not require the assumption Q ~ 
P) is super-hedged by some (5,P)-integrable process with 9 ■ S = 9 ■ S, Q-a.s. By the 
monotonicity of robust utility functional, we see that 9 is an optimal strategy without the 
additional assumption Q ~ P (see [23] and [22]). However, this argument essentially relies 
on the fact that X is bounded below by — x (since U (x) = — oo for x < 0), and no longer 
works when the utility function is finite on the entire real line. Thus we can not drop the 
assumption Q ~ P (at now). 

Remark 3.4 (Random Endowment). The results of this paper may also be stated with a 
random endowment B as long as it is an ^-measurable random variable satisfying 

VP G V, 3e P > such that U(~e P B+) G L 1 (P) , 

(3.5) 

3e > such that {U(-(l +e)B )dP/d¥} PeV is uniformly integrable. 
Then the robust utility maximization problem (2.6) reads as 

(3.6) u B {x):= sup inf E P [U(x + 9-S T +B)], 

eee bb PeV 

Assumption (3.5) implies that B G flge-My ^ and guarantees under (Al) - (A5) that 
a duality corresponding to (2.10) holds true [18, Theorem 2.3]: 

(3.7) sup inf Ep[U(x + d-S T +B)] = inf inf (V{XQ\V)+Xx + XE Q [B}), 
ee® v PeV X>0QeM v 

With the same assumptions, the dual problem admits a maximal solution with the unique 
density in the sense of (2.1 1). Then Theorems 3.1 and 3.2 remain true with similar proofs, 
and with obvious modifications, e.g., (3.3) is replaced by x+X +B = —V' (XdQ/dP) = 
x + 9-St+B, Q-a.s. We omit the details. See [18] for the treatment of random endowment 
and other implications of (3.5). 
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4. Optimal Claim 

We first note that we have only to consider the case x — 0. Indeed, assumptions (A3) and 
(A4) on the utility function are invariant under the translation of utility function from U to 
U x (%) := U(x + and all the results for i^O follow from those for x = applied to the 
new utility function U x . Thus we assume x = in what follows. 

The next technical lemma is a collection of several arguments in [4]. 

Lemma 4.1 ([4]). Let (Q,P) be a pair of probabilities with V(Q\P) < oo, and {k n ) n a 
sequence of random variables such that Ep[U(k n )] is bounded from below and EQ[k n ] < 
for all n. Then 

(a) (k") n is bounded in L l (Q); 

(b) (U(k")) n is bounded in L l (P); 

(c) If in addition k" converges a.s. to some k £ L , we have k £ L l (Q), U (k) £ L 1 (P) and 
that 

(4.1) E Q [k] < and \imsup E P [U(k")} < E P [U(k)]. 

n 

Proof. We just fill the gap from [4]. As we are assuming the reasonable asymptotic elas- 
ticity (A4), assertions (a) and (b) are contained in Proposition 6.3 of [4]. The assertion (c) 
also appears (implicitly) in the proof of their Theorem 4.10, which we briefly recall here. 

Assume k" -> k, P-a.s. Since (k" ) (resp. (U(k n )) is bounded in L l (Q) (resp. L l (/>)), Fa- 
tou's lemma applied to the sequence (resp. (\U(k n )\) n ) shows that k £ L 1 (Q) (resp. 

U(k) £ L 1 (P)). By Young's inequality, we have U(k") ~ X(dQ/dP)k n < V{XdQ/dP) £ 
L l (P) for all n £ N and A > 0, where the P-integrability of the right hand side for all A 
follows from the reasonable asymptotic elasticity. By this integrable upper bound as well 
as the assumption Eg[k"] < 0, (reverse) Fatou's lemma shows that 

limsup E P [U(k")] < limsupEp[U (k") - X{dQ/dP)k"] 

n n 

<E P [U(k)-?i(dQ/dP)k]=Ep[U(k)}-?iE Q [k],yi>0. 
Letting A 1 0, we have (4. 1), while Eq [k] < follows by letting A f oo. □ 
Proof of Theorem 3.1. We choose a maximizing sequence (9 n ) n C that is 

(4.2) MEp[U{6 n -S T )]/-u{0). 

This sequence does not have to converge, thus we appeal to a Komlds type argument. Let 
(Q,P) £ M v xT be such that Q - P - P and V(Q\P) < oo which exists by (A5). Since 
Ep[U(e n -S T )} >mf PeV Ep[U(0 l -S T )} and Eg [9" -S T ] < by construction, Lemma 4.1 (a) 
shows that (6" ■ Sj)n is bounded in L l (Q). Hence Komlos' theorem (see e.g. [6, Theo- 
rem 15.1.3]) yields another sequence (k n )„ such that 

k" £corw(9 n -S T ,9" +1 -S T ,---) 
k" converges Q-a.s. (hence P-a.s.) to some X £ L 1 (Q). 

By construction, each k" is again the terminal value of a stochastic integral 9" ■ Sp where 
9" is the convex combination of (9", 9" +l , • • • ) with the same convex weights as k", hence 
9" £ &bi, and Eq[Ic"} < for each n and Q, in particular. 

Since the robust utility functional X M> infp e p Ep[U (X)] is concave as a point-wise 
infimum of concave functionals, we have mfp e -p Ep[U (k n )] > inf p e -p Ep[U (9 '" - St)] for 
each n. Hence we still have lim„inf/> e 'p.E , p[[/ (k")] = u(Q), and the sequence (Ep[U (k")]) n 
is bounded from below for all P £ V. 
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If Q € Mv, there is a P e P with V(g|P) < oo by the definition of My, hence another 
application of Lemma 4.1 to the sequence ik") with the pair (Q,P) shows that X G L 1 (g) 
and £ Q [Z] < 0. Hence X <E X. 

We next show that U(X) E f] PeV L 1 (P) and 

(4.3) limsup E P [U{k")} <E P [U(X)], VPeV. 

n 

This is immediate from Fatou's lemma if U is bounded from above. When U(oo) = oo 
and P e V e , we can take age jVly with V(<2|-P) < oo by (2.12), hence Lemma 4.1 shows 

(4.3) and that (U(k"))„ is bounded in L l (P). Then Remark 2.3 shows that U(X) € L l {P) 
and (U (k n )) n is still bounded in L l (P) for arbitrary fe? which need not be equivalent to 
P. To prove (4.3) in the case P ^ P, we take (Q,P) as above, and set P a := aP+ (1 - a)P 
for a € (0, 1). Since P a ~ P, the claim is true for P a for all a e (0, 1), while we see 
that sup„ |£ P „[C/(F)]-£p[I/(r)]| < 2(1 - a) S up„(||C/(fc")|| il(P) V \\U(k")\\ LHP) ) 0, as 
a f 1. Thus we deduce 

limsup£'/>[C/(F 1 )] = limlimsup£ , a/ , + n_ C( , |/i[t/(P)] 

n «fl n 1 ; 

< hm£ aP+(1 _ a)P [C7(X)] =£i.[C/(Z)]. 

Hence (4.3) holds for all P £ V. 

We now prove (3.2). Note first that for all A > 0, X e A", g e A^v and Pe?, 

£p[C/(X)] < V(Ag|P) + A£ e [X] < V(XQ\P). 

In particular, 

inf E P [U{X)\ < inf inf VfAglP) ( = 0) u(0), VX e A", 
Pev l>o{Q,P)eM v 

On the other hand, (4.3) shows 

w(0) = lim inf E P \U(k n )] < inf limsup E P \U (ft 1 )} < inf E P \U(X)}. 
n Pev Pev n Pev 

This concludes the proof of (3.2). 
We proceed to (3.3). Notice that 

(4.4) U{X) = V(XdQ/dP)+X(dQ/dP)X, P-a.s. 
Indeed, "<" is just a Young's inequality, while ">" follows from 



„ 0) 

m(0) = m^Ep[U(X)] < Ep[U(X)] < Ep 
<V(XQ\P) ( = U) M (0). 



dP dP 



Here (i) follows from the "<" part, and (ii) from X E X. In particular, P attains the infimum 
in (3.2) and we obtain (4.4). But an elementary knowledge from convex analysis shows 
that this is possible only if 

X = -V'(XdQ/dP), P-a.s. 

This is the first equality in (3.3), and the Q-a.s. uniqueness of X follows from that of 
XdQ/dP (see (2. 11)). On the other hand, the existence of G 1(5, Q) with O = and 9 ■ S 
being a g-martingale, which represents —V' (XdQ/dP) as (3.3), follows from Theorem 3.2 
of [11] (see also [20, Theorem 2.2 (iv)]). Finally, Q-a.s. uniqueness of the process ■ S 
follows from the Q-a.s. uniqueness of the terminal value 9 ■ S p and the fact that 6 ■ S is a 
2-martingale. □ 



ADMISSIBLE STRATEGIES IN ROBUST UTILITY MAXIMIZATION 



11 



5. Uniform Supermartingale Property of Optimal Wealth 

We now proceed to the uniform supermartingale property of the optimal wealth, that is, we 
shall show that 9 ■ S is a supermartingale under all local martingale measures Q with finite 
entropy w.r.t. some P E V . As outlined in Section 3, this will follow if we can prove the 
dynamic variational inequality (3.4) for every Q £ Mv- Therefore, the key of this section 
is the next proposition which should be compared with [8, Lemma 3.12]. Recall that we 
have only to consider the case x = 0. In what follows, all the assumptions of Theorem 3.2 
are in force, and we do not cite them in each statement. 

Proposition 5.1. We have 

1. for all Q € Mv, and for all stopping time T < T, 



(5.1) 



V' (XdQ/dP) T z >£g V (XdQ/dP 



, Q-a.s. 



2. for all P E V, and for all stopping time X < T, 

(5.2) E P [U(B ■ St)^} > Ep[U(9 ■ St)^}, P-a-s. 

We introduce some notations. If L is a strictly positive martingale, we denote L z j := 
Lt/L t , for any stopping time T < T. Recall that any probability Q <C P is identified with a 
(uniformly integrable) martingale, namely the density process Z@ = (dQ/dF)\j?. . In what 
follows, we denote by Z (resp. D) the density process of Q (resp. P). Also, when a pair 
(GjP) € M.ioc x P is fixed, the density process of Q (resp. P) is denoted by Z (resp. D), 
and set: 

(5.3) Z? T :=aZ z . T + (l-a)Z T . T , T>% T := aD T>T + (1 - a)6 xj , a €[0,1]. 

We make a couple of simple reductions. The first one is just a notational reduction. In 
our purpose, we can assume without loss of generality that A = 1 since we already know 
A. Indeed, (%Q,P) minimizes (v,P) H> V(v|P) if and only if (Q,P) minimizes (v,P) H> 
Vx(v\P) := lV{Xv\P). Next, we have only to prove (5.1) and (5.2) for all Q e M e v and 
P € V e , respectively. Indeed, if we could show (5.1) for all Q' E My for instance, we have 
Q := (Q + Q)/2 E M v for any Q E My on the one hand, and on the other hand, Bayes' 
formula implies 

= -^yEQ^} + — ' TV] a.s. on {Z T > 0} 

where <I> = V' (dQ/dP), hence (5.1). A similar argument applies also to (5.2). 

The first step is to show a "Bellman-type" principle for a time-consistent optimization. 
Note that the set Mi oc of all local martingale measures is m-stable, while Mv is not. The 
next simple lemma allows us to avoid this difficulty. 

Lemma 5.2. Let (Q,P) E My x V with V(Q\P) < 00, and (Z,D) the corresponding 
density processes as well as a E [0.1]. Then for any stopping time T < T, the random vari- 
( z z a \ 

able D T D" T V - T „ r I is J- T -locally integrable i.e., there exists an increasing sequence 
A„ E J- z such that 

( Z Z a \ 

(5.4) P(A n ) /* 1 and \a„D z D" T V j-^f E L 1 , Vn. 
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Proof. Since D T D" T V I ^g-J < aD x D %T V (JjgrJ +(l-Cc)& T V (see the proof 

of Lemma 5.5 below), and the second term is integrable, it suffices to prove the case 05 = 1. 

Recall from [10] that the condition (A4) of reasonable asymptotic elasticity is equivalent 
to: for any a > 1, there exists C a ,C' a > such that 

(5.5) V(Xy)<C a V{y)+C a (y+l) 1 VA € [a~ 1 ,a],Vy> 0. 

Since V is bounded from below by U (0), we can choose the constant C' a so that the right 
hand side is always positive. For the sequence A„, we take 

A n := {Z T ,Z T ,D T ,D T e (n-\n)} £ T T , Vn. 
Noting that 9 := D T D rX V = §^rV (fgg), (5.5) implies that 

9 < n 2 C„4D T V{Z T /D T ) +n 2 C' n4 {Z T +D T ) a.s. on A„. 

Thus 1a„<P € i- 1 for each «. Finally, P(A„) /*• 1 since g^P^g^P^Pby assumption. 

□ 

Lemma 5.3. For any (Q,P) ~ (Z,D) € A4y x "P 6 w/f/i V(g|P) < oo, a £ [0, 1], 



(5.6) 



Z T V 



<E 



D t D" T V 



Proof. Note first that the conditional expectation of the right hand side is well-defined and 
a.s. finite by Lemma 5.2. Let C be the set on which the inequality (5.6) fails, which is 
^-measurable. Then we suppose by way of contradiction that P(C') > 0. 

Take a sequence (A„) C T x as in Lemma 5.2 and a large n so that P(C'nA„) > 0. Setting 
C := C n A„, we define a new pair (Q,P) ~ (Z,D) by 

Z T = IoZt + 1 C Z T Z? T and D T = \ C cD T + 1 C D T D^ T . 

First, (Q,P) £ Mioc x V by the m-stability of M[ oc and V . Also, since 



5 r y 



D T 



= \ C cD T V 



{d t ) 



i c £>*d" t v 



7 7 a 



we have V((5|P) < oo by the construction of C and Lemma 5.2, hence Q £ M. v . Finally, 



V(Q\P)=E 



D T V 



D T 













Ms) 




+ l C E 







D T D° T V 



<V(Q\P). 

This contradict to the optimality of (Q,P). 

Now the formal inequality in Step 1 at the end of Section 3 is realized as follows. 
Proposition 5.4. For any (Q,P) ~ (Z,D) £ My x V e with V(Q\P) < oo, 



a 



(5.7) 



Z T {e q [V (dQ/dP) 



-E f 



V (dQ/dP) | J- jj } 



-t> T {E P [U{l)\F^-Ep{U{t)\F T ]} >0, «w. 
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Proof. Let (Z,D), T, a be as above, and set 

G x {a) :=b x Dl T V(Z z Zl T /b x Dl T ). 

Then a H> G T (a) is convex (a.s.) by (the proof of) Lemma 5.5 below, hence (G T (a) — 
G(0))/a decreases a.s. to the limit E T (g,P) as a \ 0. Here Z T (Q,P) is explicitly com- 
puted as: 

E T (e,P) =Z T V' (Z T . r -Z T , r )+D T f/(X)(D Ti r-D T , r ), 

using Z r /,D r = rfg/rfP and C/(l) = V{dQ/dP) - (dQ/dP)V (dQ/dP). Since G T (1) is 
^-locally integrable and E[(G T (a) — G X (Q)) / a\F T ] > a.s. by Lemma 5.3, the (gener- 
alized) conditional monotone convergence theorem shows that E[Z(Q,P)\J r x ] > 0. Noting 
that V'(dQ/dP) = —X E L 1 (Q) and U(X) £ L l (P) by Theorem 3.1, we deduce (5.7) from 
Bayes' formula. □ 

We proceed to Step 2. Fixing Q 6 My, we want to take P "arbitrarily close" to P. The 
next simple lemma gives a precise form of this argument. 

Lemma 5.5. Let (Q,P) and (Q 1 ,P') be any two pairs of probability measures absolutely 
continuous w.r.t. P. Then for any a,y€ (0, 1), we have 

V(aQ+(l - a)Q'\yP+ (1 - y)P r ) 



(5.8) 



<rv(-Q 



a 



P)+i}-i)V[ l r-^Q' 



p> 



1-7' 

In particular, V(Q\P) < oo and V(Q'\P') < oo imply V (aQ + (1 - a)Q'\yP+ (1 - y)Q') < 
oo for any a,y<E (0, 1). 

Proof. Note that for any positive numbers x,x',y,y', 

ax+(l-a)x' yy ax (1-7)/ I — ax' 

ry+i}-7)y' yy+{t-y)y'yy w+(i-r)/ 1-7/' 

Thus the convexity of V shows that 

' ax + (l - a)x?' 



{yy + {l-y)y')V 



yy+{i-y)y' 



,' ax\ . , , / 1 — a x' 
<yyV[--)+(l-y)y'V 



yy) yi- Y y y 
Putting dQ/dP (resp. dQ'/dP, dP/dP, dP'/dP) into jc (resp. y, /), and taking the 
P-expectation, this implies (5.8). The second claim follows from the fact that V (Q\P) < oo 
=> V (XQ\P) < oo for any X > 0, as a consequence of reasonable asymptotic elasticity. □ 

Proof of Proposition 5.1. As noted after the statement of Proposition 5.1, we have only to 
consider the case (Q,P) E My x V e with V(Q\P) < oo. Fixing such a pair (Q,P), we put 
Qa :=ag+(l-a)gandP y :=yP+(l-y)Pforany a, ye (0,1). By Lemma 5.5, the 
auxiliary variational inequality (5.7) is valid for any {Qa^Py) with arbitrary a. y G (0, 1). 
Noting that E Qa [4>| F x ] -E & [9\ T x \ = a ^_ a% {Eq - E & [<&[ J>] } etc, we have 

- {£ e [y ' (^eMP) | j- T ] - £g [v ' (dQ/dP) | j- T ] } 



aZ t + (l-a)Z r 
yD 

c yD T + (i 

> 0,a.s. Va,7G (0,1 



^ - J®' , A {£ f [t/(X)|J- T ] -^[f/(X)|jr T ]} 
yD T + (l -y)D T 
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y 1 a 1 

Since yD T /{yD x + {\-y)D r ) ^ Oand aZ x /{aZ z + {\ -a)Z T ) 4 0, we deduce (5.1) and 
(5.2) by letting y J, (resp. a J. 0) with a (resp. y) being fixed, whenever V(2|P) < 00. 
Finally, any Q G ,M V (resp. P G V e ) admits aFef (resp. g G .My) with V(g|P) < 00 
by definition (resp. by Remark 2.3). □ 

Proof of Theorem 3.2. Under the assumption Q ~ P, the (5,P)-integrability of 9 is clear. 
We verify that ■ S is a supermartingale under each Q G A4y. Since V' (dQ/dP) G i 1 (2), 
the process defined byM^ = -£ Q [7'(djg/d^)| J" T ] 

is a g-martingale. Then (3.3), (5.1) as 
well as the fact that 6 ■ S is a g-martingale show that 

-S T - -EQ[V'{dQ/dP)\F x ] >M$, g-a.s. 

for any stopping time T <T. A stochastic integral w.r.t. a Q-local martingale dominated be- 
low by a ^-(uniformly integrable) martingale is a g-supermartingale by [24, Theorem 1], 
which is a variant of Ansel-Strieker's lemma [1, Proposition 3.3]. □ 
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